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(54) Interactive recording/reproducing medium and reproducing system 



(57) An interactive recording/reproducing medium 
including: 

Image data; image reproduction control data which 
defines an operation instruction received from operation 
input apparatus and a reproduction procedure for said 
image data In correlation witii each other, said operation 
input apparatus performing a reproducing operation for 
said image data in an Interactive manner; image related 
data related to tiie contents of said image data; and 
relation defining information which defines tiie relation 
between said image related data and said image data. 
More particularly, an interactive recording/reproducing 
system which is interactively responsive to operations 
made by a user, which defines information such as iexX 



data (e.g., ASCII text) in association with an image and 
reproduces the text data sinrtultaneously witii reproduc- 
tion of the image. An optical disk medium comprises a 
Video-CD recording area for recording image data (e.g. 
dynamic images, static images, voice) which conform to 
a basic Video-CD standard, a PC data recording area 
for recording text data associated with the image data, 
and a reproduction application recording area for 
recording a program to effect reproduction using a PC 
(personal computer). A Video-CD reproducing system 
and a PC can be alternatively used to perform reproduc- 
tion using a content of tiie optical disk medium. 



F/a 1 



CM 
< 

CM 
CM 

CM 
iO 
1^ 

O 

0. 

LU 



BNSOOCID: <EP_0762422AZJL> 




102 



120 



1 1 




PRINTER 









103 



Primed by Rank Xerox (UK) Business Services 
2.13.16/3.4 



1 



EP 0 762 422 A2 



2 



Description 

BACKGROUND OF THE INVENTIQM 
Reld of the Invention 

The present invention relates to an information 
recording system (e.g. optical disk) in which is recorded 
with multimedia information including images such as 
dynamic and static images, as well as voice. Particu- 
larly, the invention is concerned with an interactive 
recording/reproducing system which is conelated inter- 
actively with operations made by a user using a per- 
sonal computer or the like and which reproduces 
multimedia information and text data from a package 
medium such as an optical disk and a network medium. 

Description of Related Art 

With regard to a multimedia information recording 
system which is interactively correlated with operations 
of a user, a Video-CD was introduced in Nikkei Electron- 
ics (November 8. 1993). In such a CD-ROM of this 
Video-CD, tiiere are recorded image data such as 
dynamic and static images, audio data such as music 
and accompanying sound effects, and further, repro- 
duction control data which control reproduction of tiie 
image data and audio data in accordance witii opera- 
tions of a user. By utilizing the recorded reproduction 
control data, the Video-CD realizes reproduction which 
is interactive witti tiie user. Further, the Video-CD 
defines a file system conforming to ISO 9660 as a 
recording system for a CD-ROM. and has been report- 
edly easily reproducible with a corresponding personal 
computer provided with means for reproducing image 
data (conforming to the MPEG standard). 

Further, as a system which is a combination of a 
computer and image data, a picture-in-picture system 
was disclosed in Japanese Patent Laid-Open No Hei 4- 
227381 (1992). According to this system, image data 
stored in a video RAM disposed within a TV set is trans- 
ferred through a computer interface to a computer hav- 
ing an external recording medium, thereby permitting a 
common utilization of image data between the two. 

The teachings of each of the above-listed and any 
below-listed references are herein incorporated by ref- 
erence. 

Turning now to problems in the art, the Video-CD 
standard does not define any reproduction procedure in 
a case where text data is used as reproduction data, 
although image data and audio data can be reproduced 
using a personal computer. In the case of a character 
display, therefore, there is no other way tiian recording 
text data as image data of the character display, thus 
resulting in a data volume that becomes considerably 
larger in comparison with other text data (e.g.. ASCII 
text data) having the same character Information. 

Further, according to the above^esaibed picture- 
in-picture system, it is possible to fetch image data in a 
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TV set into a computer, but nothing Is shown therein 
about the relation between the image data tiius taken in 
and the data presented by the personal computer itself. 

5 SUMMARY OF THE INVENTTQN 

In view of the above-mentioned problems, the 
present invention has an object to provkJe an interactive 
recording/reproducing system which is responsive inter- 

10 actively to operations peribrmed by a user, which can 
define information capable of being controlled by a per- 
sonal conputer (such as text data in association with an 
image), and which can record such text data in a same 
recording medium as tiiat for image data while contain- 

15 ing much information (e.g., text data) with a small data 
volume. 

According to the present invention, in order to 
achieve the above-mentioned object, there are used 
dynamic images, static images, voice, and image data 

20 as a combination tiiereof; operation input means which 
performs an image data reproducing operation interac- 
tively: image reproduction control data which defines an 
operation instruction received from tiie operation input 
means and an image data reproducing procedure in 

25 correlation with each other; image data reproducing 
means which receives an operation instruction from the 
operation input means, acquires a corresponding repro- 
duction procedure from the image reproduction control 
data, and reproduces the image data in accordance 

30 with tiie reproduction procedure acquired; image 
related data related to tiie contents of tiie image data; 
relation defining information which defines tiie relation 
between tiie image related data and the image data; 
and image related data reproducing means which 

35 acquires from the relation defining information the 
image related data related to tiie image data being 
reproduced and reproduces it togettier witfi reproduc- 
tion of the image data. 

Further, external information defining data for 

40 obtaining multimedia data through a communication line 
is recorded in a medium. In addition, the image data and 
tiie image reproduction cont-ol data are recorded in 
accordance witii a basic Video-CD standard, and tfie 
image related data and the external information defining 

45 data are recorded as a file of a HTML (Hyper Text 
Markup Language) format used in the Internet. Moreo- 
ver, in obtaining multimedia data from a location exterior 
to tiie system, a URL (Uniform Resource Locator) indi- 
cating tiie location of tiie multimedia data are described 

50 in the file of HTML format, making it possible to obtain 
data from an appropriate WWW (World Wide Web) 
server. 

According to tiie Interactive recording/reproducing 
system of the present invention, tiie image data repre- 
ss ducing means receives an operation instruction from 
the operation input means, acquires a con-esponding 
reproduction procedure from the image reproduction 
control data, and reproduces image data in accordance 
witii tfie reproduction procedure acquired. At tiie same 
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time, the image related data reproducing means 
acquires from the relation defining information the 
inrage related data related to the image data being 
reproduced and reproduces the acquired image related 
data. The image data, the image reproduction control s 
data, the image related data and the relation defining 
information are recorded in a single recording medium. 
The image data reproducing means and the image 
related data reproducing means read out each informa- 
tion from the single recording medium and reproduce it. ra 

Further, in reproducing a file of a HTML format, the 
reproducing means reproduces the image data with ref- 
erence to the file of the HTML format, and obtains and 
then reproduces the multimedia data through the com- 
munication line. In obtaining the nfiultimedia data, the r5 
URL described in advance in the file of HTMLformatare 
refen^ed to, and the data is obtained from an appropriate 
WWW server through the communication means for 
reproduction. 

The foregoing and other objects, advantages, man- 20 
ner of operation, novel features and a better under- 
standing of the present invention will become apparent 
from the following detailed description of the preferred 
embodiments and claims when read in connection with 
the acconrpanying drawings, all forming a part of the 2s 
disclosure hereof this invention. While the foregoing and 
following written and illustrated disclosure focuses on 
disclosing embodiments of the invention which are con- 
sidered prefen-ed embodiments at the time the patent 
application was filed in order to teach one skilled in the so 
art to make and use the invention, and to othenvise sat- 
isfy the best mode disclosure requirements under U.S. 
patent law, it should be clearly understood that the 
same is by way of illustration and example only and is 
not to be taken by way of limitation, the spirit and scope 35 
of the present invention being tjasic only by the terms of 
the appended claims. 



40 



BRIEF DESCRIPTION OF THE DRAWlNGfS^ 

The following represents brief descriptions of the 
drawings, wherein: 



Fig. 1 is a diagram showing the construction of an 
Interactive recording/reproducing system embody- 45 
ing the present invention; 

Fig. 2 is a diagram showing an example of a direc- 
tory structure of an optical disk medium embodying 
the present invention: 

Figs. 3a and 3b are diagrams showing part of so 
image reproduction control data according to a 
basic Video-CD standard; 
Fig. 4 is a diagram showing an example of opera- 
tion made by a user and a corresponding output 
display in a basic Video-CD player; ss 
Fig. 5 is a diagram showing an exannple of con- 
struction of a basic Video-CD player; 
Rg. 6 is a diagram showing a flow of operations of 
a basic Video-CD player; 



Rg. 7 is a diagram showing an example of output 
display made by a personal computer in the first 
embodiment of tiie present invention; 
Rg. 8 is a diagram showing an example of image 
PC data link table in the first embodiment; 
Rg. 9 is a diagram showing an example of opera- 
tion made by the user and a corresponding output 
display in the first embodiment; 
Rg. 10 is a diagram showing a configuration exam- 
ple of an interactive recording/reproducing system 
in the first embodiment; 

Rg. 11 is a diagram showing a flow of operations of 
image data display means in the first embodiment; 
Rg. 12 is a diagram showing an example of output 
display made by a personal computer in tiie second 
embodiment of the present invention; 
Rg. 13 is a diagram showing an example of opera- 
tion made by tiie user and a corresponding output 
display in the second embodiment: 
Rg. 14 is a diagram showing a configuration exam- 
ple of an interactive recording/reproducing system 
in the second embodiment: 
Rg. 15 is a diagram showing the flow of operations 
of image data display means in the second embod- 
iment; 

Rg. 16 is a diagram showing an example of output 
display made by a personal computer in the third 
embodiment of tiie present invention; 
Rg. 1 7 is a diagram showing a configuration exarn- 
ple of an interactive recording/reproducing system 
in the tiiird embodiment; 

Rg. 18 is a diagram showing the flow of operations 
of image data display means in tiie tiiird embodi- 
ment; 

Rg. 19 is a diagram showing an example of image 
reproduction control data management table in the 
fburtfi embodiment of the present invention; 
Rg. 20 is a diagram showing a relation between 
image data reproduced and PC data displayed in 
tiie fourth embodiment;, 

Rg. 21 is a diagram showing a configuration exam- 
ple of an interactive recording/reproducing system 
in the fburtii embodiment; 

Rg. 22 is a diagram showing the flow of operations 
of image data display means in tiie fourth embodi- 
ment; 

Rg. 23 is a diagram showing the construction of an 
interactive recording/reproducing system embody- 
ing tiie present invention; 

Rg. 24 is a diagram showing an example of a direc- 
tory stnjcture of an optical disk medium embodying 
the present invention; 

Rgs. 25a-b are a display example of reproducing 
an optical disk medium embodying tiie present 
invention using a basic Video-CD reproducing 
means; 

Rg. 26 is a display example of reproducing an opti- 
cal disk medium embodying the present invention 
using a WWW browser; 
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Rgs. 27a-b are diagrams showing the contents of a 
* file of HTML format recorded in an optical disk 
medium embodying the present Invention; and 
Figs. 28a-b are diagrams shewing the contents of a 
file of HTML format recorded in an optical disk s 
medium embodying the present invention. 

DETAILED DESCRIPTION OF THE PREFERRgP 
EMBODIMENTS OF THE INVENTIOM 

10 

Before beginning a detailed desaiption of the sub- 
ject Invention, mention of the following is in order: 

When appropriate, like reference numerals and 
characters are used to designate identical, correspond- 
ing or similar components in differing figure drawings. is 

In the following discussions, TC" is an abbreviation 
standing for "personal computer". 

Turning now to a detailed desaiption of a prefened 
embodiment of the invention, Fig. 1 is a diagram show- 
ing an example of construction of an interactive image 20 
recording/reproducing system according to the present 
invention, in Fig. 1 there are illustrated a logical struc- 
ture of an optical disk medium 101 and reproducing sys- 
tems for reproducing such medium. The optical disk 
medium 1 0 1 comprises a Video-CD recording area 1 04, 25 
a PC data recording area 105 and a PC application 
recording area 106. The Video-CD as refen-ed to herein 
takes into consideration an industry standard relating to 
a digital image recording/reproducing system using a 
compact disk. 30 

According to the present invention, image data 
(dynamic and static images, voice, and a combination 
thereof) conforming to a Video-CD standard is recorded 
in the Video-CD recording area 104, text data related to 
the image data is recorded in the PC data recording 35 
area 105, and a program for effecting reproduction of 
the image data and the text data by a PC is recorded in 
the PC application recording area 106. The optical disk 
medium 101 is reproduced either by using a Video-CD 
reproducing system 1 02 which is a combination of a TV 40 
set and a Video-CD player, or by using a personal com- 
puter 103 (hereinafter referred to simply as PC 103) 
having a function (e.g., MPEG decoder) to reproduce 
image data conforming to the Video-CD standard. 
According to the present invention, the Video-CD repro- 45 
ducing system 102 performs reproduction conforming to 
the Video-CD standard using means which will be 
described later, while the PC 103 executes a PC appli- 
cation recorded in the PC application recording area 
1 06 using means to be described later. so 

Fig. 2 shows an example of a directory structure in 
the optical disk medium 101 . According to this directory 
structure, recording is made taking into consideration 
the ISO 9660 standard (a standard relating to a disk 
structure of a CD-ROM). The same figure illustrates a ss 
tree structure of a logical directory hierarchy, wherein, 
for the name of each node portion, a directory name is 
bracketed ((.)), while a file name is shown without 
brackets. For example, < ROOT) indicates a root direc- 



tory which includes some subdirectories, and PBC.DAT 
stancte for a single particular file. The Video-CD record- 
ing area 104. PC data recording area 105 and PC appli- 
cation recording area 106 shown In Rg. 1 correspond to 
areas 104. 105 and 106, respectively which are 
enclosed with dotted lines in Fig. 2. 

The structure of a directory and a file recorded in 
the Video-CD recording area 104 is standardized, which 
standard defines that necessary files should be 
recorded in conformity with ISO 9660. The structure in 
question comprises a directory ((VIDEO) in Fig. 2) for 
recording MPEG (a standard relating to image com- 
pression), image data (e.g. VIDEO.001, VIDEO.002 in 
the same figure) according to MPEG, a directory 
((MENU)) for recording MPEG image data (e.g. 
MENU.001, MENU.002) used in, for example, display- 
ing a menu, and a directory ((PBC ) for recording image 
reproduction control data (PBC.DAT) describing a file 
reproduction procedure. , 

Ihe file names and directory names depicted in the 
figure are not the same as those defined by the Video- 
CD standard, nor do they show all of the files defined by 
the same standard. More particularly, the PC data 
recording area 105 is newly added in the present inven- 
tion and is herein depicted as having a directory (PC). 
In the PC data recording area 105. there are recorded 
text files (INFOFILE.001, INFOFILE.002 In Fig. 2) which 
are related to the image data recorded in the Video-CD 
recording area 104, and a link table (PCLINK.TBL) for 
providing correlation. The PC application recording area 
106 is newly added In the invention and is herein 
depicted as having a directory (PCAP ). In the area 106, 
there is recorded a program file (VIDEOCD.EXE) for 
performing reproducton of image data and text data by 
means of a PC. 

Description will be first be directed to an interactive 
image reproducing procedure conforming to a basic 
Video-CD with reference to Figs. 3a-b to 6. More partic- 
ularly Figs. 3a-b show an example of a portion of the 
image reproduction control data (PBC.DAT in Fig. 2). 
The format of the image reproduction control data is 
defined by a basic Video-CD standard. Such basic 
standard prescribes reproduction procedure describing 
units for image data (one or plural) to be displayed for 
particular ones of (i.e., corresponding to) user opera- 
tions or various events. In the present invention, the 
reproduction unit is e)g)ressed as a node. The image 
reproduction control data give independent node num- 
bers to plural nodes, and describe a reproduction proce- 
dure for each node. 

As one example, Figs. 3(a) and (b) are examples 
showing reproduction procedures for node numbers 1 
and 3. Fig. 3(a) indicates that the node number is 1 and 
that the file name of the image data reproduced at the 
node number 1 Is MENU.001. Further, for user opera- 
tions or events, a node number to be shifted to next (in 
response to a user input) is designated. For exanple, in 
a case where node number 1 (Rg. 3a) is being effect 
and where a key input made by a user is a PREVIOUS 
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indication (which means "Return to previous'^, no reac- 
tion occurs, that is, the key input is ignored. In contrast, 
where the user key irput is SELECT1, the node corre- 
sponding to SELECT1 is 3. such that a shift is made to 
the node number 3 (Fig. 3b). Upon shift to the node 
number 3, the reproduction procedure for the node, 
number 3 (Fig. 3b) is acquired from among the image 
reproduction control data and reproduction control is 
made in accordance with the acquired reproduction pro- 
cedure. Fig, 3b is a diagram showing the reproduction 
procedure for the node number 3, describing that image 
data VIDEO.001 should be reproduced first. 

In the above-described Figs. 3a-b there are shown 
only two nodes, but in a practical application, plural such 
nodes are typically included in the image reproduction 
control data. Although the identity of image data to be 
reproduced is specified in terms of a file name, there 
may be used, for example, a recording address on a 
CD-ROM if it can be identified. As to the event names 
shown in Fig. 3, PREVIOUS means "Return to previ- 
ous," NEXT means "Advance to next," RETURN means 
"Return to the previous menu," SELECTxx means 
"Select key number xx" (the mark xx should be replaced 
by a number), and REPRODUCTION END means the 
end of image data reproduction. Such listing is only 
exemplary, and is not an exhaustive list of possible 
types of events within the basic Video-CD standard. 

Fig. 4 shows an example of user operations and 
con^esponding output displays in the case of reproduc- 
ing the optical disk medium 101 by the Video-CD repro- 
ducing system 102, in accordance with the image 
reproduction control data shown in Figs. 3a-b. More par- 
ticularly, assuming the node in Fig. 3(a) represents a 
beginning of an image reproduction control data, upon 
start of reproduction of the optical disk medium 101 , the 
Video-CD reproducing system 102 reproduces the 
image data MENU.001 described at the node number 1 
(output display 401 in Fig. 4). This output display shows 
the user that it is necessary to select either Lesson 1 or 
Lesson 2 with a key number 1 or a key number 2. Next, 
when the user nrakes key input of SELECT1 , the Video- 
CD reproducing system 102 acquires the reproduction 
control data of the node number 3 corresponding to the 
SELECT1 event of the node number 1 , and displays the 
image data VIDEO.001 described in the node number 3 
(output display 402 in Fig. 4). 

The above operations of the Video-CD reproducing 
system 102 will be explained below with reference to 
Figs. 5 and 6. More particularly. Rg. 5 shows an exam- 
ple of construction of the Video-CD reproducing system 
102. In Fig. 5. numeral 501 denotes an image data 
group recorded in the Video-CD recording area 104. 
which data group is a collection of the image data (e.g. 
VIDEO.001, MENU.001) shown in Fig. 2. Numeral 502 
denotes the image reproduction control data (PBC.DAT 
in Fig. 2) for controlling the reproduction of the inr^ge 
data group 501 . The blocks of numerals 503 to 507 con- 
stitute the Video-CD reproducing system 102. More 
specifically, numeral 503 denotes operation input 



means for operation input by the user, which input 
means is constituted, for example, by using an infrared 
remote controller, an infrared receiver, an input code 
generator, and/or a keyboard, etc. Numeral 504 denotes 

5 image reproduction control data storage means consti- 
tuted, for example, by using a semiconductor memory 
which stores the image reproduction control data 502. 
Numeral 505 denotes image data display control means 
for controlling the reproduction of image in accordance 

10 with the image reproduction control data 502. Numeral 
506 denotes image data decoding means which has a 
function of decoding MPEG image data. Numeral 507 
denotes image data display means for displaying the 
decoded image data. 

15 Rg. 6 is a flowchart showing a flow of operations of 
the image data display control means 505 after inser- 
tion of the optical disk medium 101 into the Video-CD 
reproducing system 102. More particularly upon inser- 
tion of the optical disk medium 101 into the Video-CD 

20 reproducing system 1 02. the image data display control 
means 505 reads the image reproduction control data 
502 from the optical disk medium 101 and stores it in 
the image reproduction control data storage means 504 
(step 601). Next, the display control means 505 reads 

25 from the image data group 501 the image data specified 
by the node written at the beginning of the image repro- 
duction control data 502, and transfers it to the image 
data decoding means 506 (step 602). The decoding 
means 506 decodes the image data and transfers the 

30 decoded data to the image data display means 507, 
which in turn displays the decoded image data. The 
image data display control means 505 stands by until 
input of an operation is made by a user (or until the end 
of reproduction of the read image data) (step 603). 

35 Next, upon receipt of an operation input from the 
user (or upon the completion of the image data repro- 
duction), the image data display control means 505 
makes reference to the node number con-esponding to 
the received operation input (or reproduction end) from 

40 the image reproduction control data 502 stored in the 
image reproduction control data storage means 504, 
and acquires the reproduction control data of that node 
number (step 604). Then, the display control means 505 
reads the image data desaibed in that node from the 

45 image data group and transfers it to the Image data 
decoding means 506 (step 605). Subsequently the 
operations 603 to 605 are repeated. 

As explained above, the basic Video-CD reproduc- 
ing system 102 performs an interactive image reproduc- 

50 tion using the data of the Video-CD recording area 104 
recorded in the optical disk medium 101 . 

Now, an interactive image reproduction procedure 
according to the present invention will be described 
below with reference to Figs. 7 to 1 1 . More particularly 

55 Fig. 7 shows an example of an output display in the 
case of reproducing the optical disk medium 101 by the 
PC 103. This output display which comprises two dis- 
play windows of 701 and 702, is generated by the PC 
application (VIDEOCD.EXE in Fig. 2) recorded in the 
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PC application recording area 106. The display window 
701 is an innage data display window which, like the 
Video-CD reprodudng systenr) 102, reproduces the 
image data recorded in the VkJeo-CD recording area, 
and comprises a reproduced image display section 703 
for the display of a reproduced image and an operation 
panel 704 for generating input codes in response to 
Video-CD interactive operations made by the user. The 
operation panel 704 Is operated with a mouse or a key- 
board of the PC 103, The same panel comprises, for 
number selection operations of the user, numeric keys 
705 for generating input codes con'esponding to 
SELECT1 and SELECT2 of the image reproduction 
control data, a reproduction key 706 for generating an 
input code to start (or terminate) ttie reproduction of 
image, a return key 707 for generating an input code 
corresponding to RETURN of the image reproduction 
control data, a previous key 708 for generating an input 
code corresponding to PREVIOUS, a next key 709 for 
generating an input code corresponding to NEXT, a 
reverse key 710 for generating an input code to rewind 
the image being reproduced, and a fonward key 71 1 for 
generating an input code to effect fast forward. The dis- 
play window 702 is a PC data display window for dis- 
playing the text data (e.g. INFOFILE.001 in Fig. 2) 
recorded in ttie PC data recording area, and is provided 
witii a keyword display button 712 for displaying the text 
data on tiie PC data display window 702. 

Fig. 8 shows an example of an image-PC data link 
table (PCLINK.TB1 in Fig. 2) recorded in tfie PC data 
recording area 105. This image-PC data link table is not 
defined by the above-described, basic Video-CD stand- 
ard, i.e., such is data newly added to the optical disk 
medium 101 by tiie present invention. The link table in 
question defines, in terms of file names, one or plural 
text data (recorded in ttie PC data recording area 105) 
associated witii the image data recorded In tiie Video- 
CD recording area 104. In Fig. 8. as to the image data 
(e.g. MENU.001 in Fig. 2) witii respect to menus, a def- 
inition of related text data is not made. In the image-PC 
data link table, a keyword is added to each text data to 
express the contents of tiie data. In tiie same figure, it is 
shown ttiat tiie text data associated witii tiie image data 
VIDEO.001 are INFOFILE.001. INFOFILE.002 and 
INFOFILE.003 and ttiat the keywords "How to greet." 
"How to answer" and "How to self-introduce" are added 
to tiiose text data, respectively 

Fig. 9 shows an exanrple of operations made by the 
user and corresponding output displays in a case of 
reproducing the optical disk medium 101 using a PC 
103 in accordance witii ttie image reproduction control 
data illustrated in Fig. 3 and the image-PC data link 
table of Fig. 8. In Fig. 9, an output display 1 is an exam- 
ple of display of tfie reproduced image display section 
703 of the image data display window 701 . while an out- 
put display 2 shows an example of display of ttie PC 
data display window 702. The operation of tiie image 
data display cortrol means 505 in connection with the 
reproduction of image data, which operation is per- 



formed in response to an operation made by tiie user. Is 
tfie same as tiiat of the basic Video-CD reproducing 
system shown in Fig. 4. When ttie reproduction of ttie 
optical disk medium 101 is started by ttie PC 103, ttie 

5 image data MENU.001 is displayed on the image data 
display window 701 , whereas ttie PC data display win- 
dow 702 does not appear on the PC 103 because 
related text data is not defined in the image data 
MENU.001. When ttie user makes key input of 

10 SELECT1. ttie image data VIDEO.001 is displayed on 
tiie image data display window 701, and at ttie same 
time tiie PC data display window 702 appears on tiie 
PC 1 03. But at ttiis stage no text data is displayed on ttie 
PC data display window 702. 

15 Next, when tiie user selects a keyword display start 
button 712 for ttie PC data display window 702. tfie key- 
words of all the text data defined for ttie image data 
VIDEO.001 by ttie image-PC data link table are dis- 
played on ttie PC data display window 702. In Fig. 9. 

20 ttiere are displayed three keywords which are "How to 
greet," "How to answer" and "How to self-introduce." 
When the user selects "How to greet" from among those 
keywords, ttie keyword list disappears and INFO- 
FILE.001. which is a text file having tfie keyword "How 

S5 to greet," is displayed on tfie PC data display window 
702. 

The above operations of the PC 103 will be 
explained below witfi reference to Rgs. 10 and 1 1 . More 
particularly. Fig. 10 shows an example of construction of 

30 an optical disk medium 1 0 1 and a PC 1 03 for reproduc- 
ing the same medium. Components similar to those in 
Fig. 5 are represented by the same reference numerals. 
In ttie optical disk medium 101 shown in Fig. 10. an 
image data group 501 and image reproduction control 

35 data 502 are recorded in the Video-CD recording area, 
while in tfie PC data recording area 105 are recorded a 
PC data group 1001, an image-PC data link table 1002 
which defines tfie relation between tiie Image data 
group 501 and ttie PC data group 1 001 , and a reproduc- 

40 tion application 1003 for executing tfie reproduction of 
-tfie optical disk medium 101 by ttie PC 103. The PC 103 
comprises operation input means 503. image reproduc- 
tion control data storage means 504, image data display 
control means 505. image data decoding means 506. 

45 image data display means 507, an image-PC data link 
table storage means 1004 for storing the image-PC 
data link table 1002, reproduction application storage 
means 1005 for storing tfie reproduction application 
1003. PC data display means 1006 for displaying PC 

50 data, and operation object discriminating means 1007 
for discriminating tfie object of operation inputted by tiie 
user. In tfiis example, ttie operation input means 503 
makes tiie display of a operation panel 704 and a key- 
word display start button 712, and acquires a user oper- 

55 ation input tiirough an input device such as a mouse, a 
keyt)oard. a touch panel, and/or an infrared remote con- 
troller. 

Fig. 1 1 comprises the flowchart of tiie image data 
display controlling operations shown in Fig. 6 and PC 
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data display controlling operations added to such flow- 
chart. In Fig. 11 , any processings similar to those In Fig. 
6 are indicated by the same reference numerals. Upon 
insertion of the optical disk medium 101 into the PC 
103, the image data reproduction control means 505 s 
loads the reproduction application (VIDEOCD.EXE in 
Fig. 2) present in the PC application recording area 106 
into the reproduction application storage means 1005 
and makes execution thereof (step 1101). The steps 
which follow are can'ied out in accordance with this w 
reproduction application. Further, the reproduction con- 
trol means 505 stores the image reproduction control 
data 502 (step 601) and stores the image-PC data link 
table 1002 present in the PC data storage area 105 into 
the image-PC data link table storage means 1004 (step is 
1 102). The image data reproduction control means 505 
transfers image data to the image data decoding means 
506, and at the same time, refers to the image-PC data 
link table 1002 stored in the image-PC data link table 
storage means 1004 (step 1 103). As a result, if there is so 
any defined text data corresponding to the transfen-ed 
image data (step 1104). the image data display control 
means 505 displays the PC data display window 702 on 
the PC 103 (step 1 105). In contrast, the image data dis- 
play control means 505 erases the PC data display win- 2s 
dow in a case where there is no text data corresponding 
to the transferred image data (i.e.. erases if the PC data 
display window 702 was previously displayed on the PC 
103) (step 1106). 

Upon operation Input from the user (step 603). the so 
image data reproduction control means 505 discrimi- 
nates, through the operation object discriminating 
means 1007. whether the object of such operation input 
is the image data display window 701 or the PC data 
display window 701 (step 1 107). In the case where the 35 
object is the PC data display window 702. the control 
means 505 makes reference to the image-PC data link 
table 1002 (step 1 108) and causes the PC data display 
means 1006 to display keyword or text data (step 1 109). 
The steps 604 and 605 are the same as in Fig. 6. so 4c 
explanation thereof is not repeated. Subsequently, 
appropriate operations of steps 1 104 to 1 109 and 603 
to 605 are repeated. 

According to this embodiment as set forth above, 
not only can reproduction of Video-CD image be per- 4s 
formed interactively, but also data controlled by a per- 
sonal computer such as text data (e.g.. ASCII coded 
text) can be recorded in a same optical disk medium in 
association witii a reproduced image. Consequentiy, the 
optical disk medium can have commentaries, in textual so 
data form, for images or the like. Hence a smaller data 
volume is accomplished in comparison to having textual 
commentaries stored as image data, thus permitting a 
larger amount of information to be recorded in the opti- 
cal disk medium. Further, since the data used can be ss 
controlled by a personal computer, it is possible to print 
the data easily using a printer 120 (Fig. 1). Therefore, 
for example in a case of image material fa an educa- 
tional program such as an English teaching material, by 
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possessing a collection of problems or the like relating 
to an image it is made possible to learn such image 
while seeing It, and to confirm the contents thereof with 
tiie use of a collection of problems having printed text 
data. Additionally, since the recording method accord- 
ing to the present invention completely covers tiie data 
which the conventional Video-CD reproducing system 
requires, it is possible to effect reproduction even in a 
conventional reproducing environment. 

Although in this embodiment keywords are first dis- 
played, a desired keyword is selected and the text data 
corresponding to the selected keyword is displayed, tiie 
keyword display may be omitted and the display of text 
data may be done directiy In this case, tiie definition of 
keyword may be omitted from tiie image-PC data link 
table. 

The following description is now provided about a 
second embodiment of tiie present invention. More par- 
ticularly Fig. 12 shows a second method for reproduc- 
ing an optical disk medium 101 having the same data 
structure as in the above first embodiment, by means of 
a PC 103. More specifically, upon input of a keyword 
from tiie user, tiie PC 103 searches such inputted key- 
word from among the keywords included in the image- 
PC data link table 1002, and displays and reproduces ] 
tiie related image data and PC data. At tiiis time, for 
example, the display made in the PC 103 is composed 
of three display windows 1201, 1209 and 1212. as 
shown in Rg. 12. 

In Fig. 12, the numeral 1201 denotes a keyword ,, 
retrieval window for facilitating a keyword retrieved on;, 
the basis of an operation made by the user, numeral . 
1 202 denotes a keyword list display box for displaying a 
list of keywords recorded in the image-PC data link table^. 
1002, numeral 1203 denotes a selected keyword dis- 
play box for displaying a keyword selected by tiie user's 
operation, numeral 1204 denotes a scroll bar for verti- 
cally scrolling tiie keyword list in accordance with tiie 
user's operation, numeral 1205 denotes a button for dis- 
playing a table of contents of keyword retrieval by tiie 
user's operation, numeral 1206 denotes a retrieval start 
button for starting the retrieval of keyword by the user's 
operation, numeral 1207 denotes a button for returning 
tiie keyword retrieval display to a display immediately 
preceding a present display by tiie user's operation, and 
numeral 1208 denotes a button for returning tiie key- 
word retrieval display to a display immediately following 
a present display by the user's operation. Further, 
numeral 1209 denotes a keyword retrieval result display 
window for the display of PC data after keyword retrieval 
in accordance witii the user's operation, numeral 1210 
denotes an image reproduction start button for instruct- 
ing, upon input from the user, reproduction of an image 
associated with tiie PC data displayed on the keyword 
retrieval result display window 1209. numeral 1211 
denotes a scroll bar for vertically saolling the PC data 
displayed on the keyword retrieval result display window 
1209 in accordance with the user's operation, and 
numeral 1212 denotes a keyword retrieval image data 
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display window for the display of an image associated 
with the PC data displayed on the keyword retrieval 
result display window 1 209. 

Fig. 13 shows sequential operations performed by 
the user and corresponding sequential output displays s 
in the PC 103 in the case of reproducing the optical disk 
medium 101 by the PC 103 on the basis of a retrieval of 
a keyword. In the same figure, output displays 1 , 2 and 
3 show display examples of the keyword retrieval dis- 
play window 1201, keyword retrieval PC data display io 
window 1209 and keyword retrieval image data display 
window 1212, respectively. 

When a reproduction of the optical disk medium 
101 based on keyword retrieval is started, the PC 103 
causes the keyword retrieval display window 1201 to is 
display a list of keywords in the keyword list display box 
1202. On the basis of the selection of a keyword ("How 
to greef in Fig. 13) as inputted by the user, the PC 103 
searches and displays appropriate keywords for 
retrieval, and displays a selected keyword in the 20 
selected keyword display box 1203. At this time, upon 
input fi.e., activation) of the retrieval start button from 
the user, the PC 103 searches for PC data associated 
with the acquired keyword from the image-PC data link 
table 1002 (INFOFILE.001 In Fig. 8), and displays such 25 
PC data in the retrieval result display window 1209. 
Next, upon input (i.e., activation) of tiie image reproduc- 
tion start button 1210 from the user, the PC 103 
searches for image data associated witii the acquired 
keyword from the image-PC data link table 1002 30 
(VIDEO.001 in Fig. 8) and displays such image data in 
the keyword retrieval image data display window 1212. 

The above operations will be explained below with 
reference to Figs. 14 and 15. More particularly, Fig. 14 
shows a construction example of an interactive image 35 
reproducing procedure according to this embodiment, in 
which tiie same components as in Fig. 10 are indicated 
by ttie same reference numerals. In Fig. 14, tiie image 
reproduction control data 602 and the image reproduc- 
tion control data storage means 504 are not used, but 
instead, a keyword refieval display means 1401 is 
newly added for display of tiie keyword retrieval display 
window 1201. At this point, it is useful to note that, while 
discussion and illustration of the present invention 
appears to discuss and illustrate multiple display means 
(e.g., keyword retrieval display means 1401, image at 
display means 507, and PC data display means 1 006 in 
Fig. 14) as separate, discrete display means, it should 
be understood that such multiple display means can be 
provided on separate display apparatus, or, in a pre- 
ferred embodiment, can be provided in separate "Vvin- 
dows" of a single display apparatjs. 

Fig. 15 is a flowchart showing the flow of operations 
of the image data display cortrol means 505 after inser- 
tion of the optical disk medium 101 into the PC 103. 
Once tfie optical disk medium 101 Is inserted into the 
PC 103, the image data display control means 505 
loads the reproduction application 1003 in the reproduc- 
tion application storage means 1005 and makes execu- 



tion thereof (step 1501). The steps which follow are 
earned out in accordance with this reproduction applica- 
tion. Next, tiie image data display control means 505 
stores the image-PC data link table 1002 into tiie 
image-PC data link table storage means 1004 (step 
1502), and causes the keyword retrieval display means 
1401 to display tiie keyword retrieval display window 
1201 in the PC 103 (step 1503). 

When ttie user selects a keyword from the keyword 
list display box 1202 and pushes (i.e.. activates) ttie 
refrieval start button 1206 (step 1504), ttie image data 
display control means 505 searches for the selected 
keyword from the image PC data link table 1002 stored 
in ttie image-PC data link table storage means 1004 
(step 1505), and causes the PC data display means 
1006 to display ttie PC data containing ttiat keyword in 
ttie keyword retrieval PC data display window 1209 
(step 1506). At ttie same time, the image data display 
control means 505 temporarily stores ttie file name of 
image data associated with the displayed PC data (step 
1507). 

Next, when the user pushes (i.e., activates) ttie 
image reproduction start button (step 1508), ttie image 
data display control means 505 reads the image data of 
the temporarily-stored file name from the image data 
group 501 , and transfers it to ttie image data decoding 
means 506 (step 1509). The image data decoding 
means 506 decodes tiie image data and transfers tiie 
decoded data to ttie image data display means 507, 
whereby ttie decoded image data is displayed in tiie 
keyword reti'ieval image data display window 1212. 
When reproduction of image data is conplete (step 
1510), the image data display control means 505 
erases ttie display window 1212 (step 1511) and tiie 
display returns to ttie keyword retrieval display. Subse- 
quentiy, ttie operations of steps 1503 to 1511 are 
repeated. Thus, according to this embodiment it is pos- 
sible to make access directly to a desired image witiiout 
going by way of a menu display Therefore, if the user 
40 remembers a keyword of an image previously seen, it is 
possible to make direct access to the image, even if 
such image is located in a deep position of tiie menu 
hierarchy 

Reference will be made below to a ttiird embodi- 
45 ment of ttie present invention. More particularly Rg. 16 
shows an example of a display outputted to ttie PC 103. 
in which example tfie optical disk medium 101 is used 
as a commodity catalog for the sale of commodities and 
a content of such optical disk medium 101 is repro- 
50 duced by the PC 1 03. The construction of ttiis display is 
tiie same as tiiat shown in Fig, 7, with the exception that 
in tiie PC data display window 702 the keyword display 
button 712 is omitted and an order instruction button 
1601 is newly provided. In ttils case, the image data 
55 reproduced in ttie image data display window 701 is/a 
commodity introducing image data, and for text data dis- 
played in ttie PC data display window 702 ttiere are 
included commodity catalog data, for example, a name 
of a commodity being introduced, a commodity number 
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serving as a reference number on an order receiver 
side, as well such commodity data as a price, color, size 
and material. Simultaneously with each change-over 
from one image data (i.e. commodity image for introduc- 
tion) to another in the innage data display window 701, 
text data displayed by the PC data display means 702 is 
also changed over to text data corresponding to that 
image data (e.g., con-esponding to a next comnrxxiity 
being introduced). This is automatically done in 
response to the user's operation. 

In this embodiment the PC 103 has a communica- 
tion function of transmitting and receiving data through 
a communication line to and from a commodity order 
reception center. Such commodity order reception 
center is a distributor of the optical disk medium 101 
providing the commodity catalog in optical disk form, 
and ^e PC data group 1001 includes an access 
number (e.g. telephone number) to the commodity 
order reception center. When the user finds out a desir- 
ous commodity while looking at the displayed image 
and selects the order instruction button 1601, the PC 
103 transmits an order information to the commodity 
order reception center included in the PC data, through 
the communication line on the basis of the access 
number. 

The above operations of the PC 103 will be 
explained below with reference to Figs. 1 7 and 1 8. More 
partcularly, Fig. 17 shows a construction exannple of an 
interactive image reproducing procedure according to 
this embodiment, in which the same components as in 
Fig. 10 are indicated by the same reference numerals. 
In Fig. 17, a commodity order application 1701 for the 
execution of a commodity order is added to the PC data 
recording area 105 of the optical disk medium 101, and 
a commodity order application storage means 1702 for 
the storage of a commodity order application is added to 
the PC 103. The operations of the PC 1 03 in connection 
with image reproduction and the display of text data are 
the same as in the first emtxxliment with the exception 
that the PC data group 1001 does not have any key- 
word, and that when PC data associated with the image 
data reproduced is defined, the PC data is always dis- 
played. Upon input (i.e., activation) of the order instruc- 
tion button 1601 by the user, the image data display 
control means 505 loads the comnrKxiity order applica- 
tion 1701 into the commodity order application storage 
means 1702 and makes execution thereof (step 1801). 
Next, the control means 505 refers to the image-PC 
data link table 1002 (step 1802), acquires data neces- 
sary for the order such as access number (e.g. tele- 
phone number) to the order reception side and 
commodity number from the PC data, and prepares an 
order information (step 1803). The PC 103 then trans- 
mits this order information to an order reception side, 
namely the commodity order reception center through 
the communication line (step 1804). 

Thus, according to this embodiment, since the user 
can choose a desirous commodity while seeing an 
accurate displayed image, the present invention is 



advantageous in that it is rarely the case that the com- 
modity image differs from the actual commodity (i e., in 
comparison with a case where the selection of com- 
modity is made using a paper catalog, magazine, or the 

5 tike). In addition, since it is possible to effect an interac- 
tive reproduction, the user can find out a desirous com- 
modity easily while looking at a menu. Further, since the 
PC 103 has a communication function, the user can 
order a commodity with a single button, and thus the 

10 operation required is simplified and is effected more 
quickly in conrparlson with an order using telephone, 
FAX. or postcard. 

Description will be directed below to a fourth 
embodiment of the present invention. More particularly. 

75 Fig. 19 shows an example of an image reproduction 
control data management table which defines condi- 
tions for the use of image reproduction control data in 
the PC 103. in a case where the optical disk medium 
101 has plural such image reproduction control data 

20 (e.g.. for multiple users). The image reproduction con- 
trol data management table is recorded in the PC data 
recording area 105 of the optical disk medium 101. This 
management table shows correlations between image 
reproduction control data and passwords. The plural 

25 image reproduction control data shown therein are 
recorded in the PC data recording area 105. The 
recorded contents are equal to the image reproduction 
procedure defined by the basic Video-CD standard. It is 
optional whether the data in question are to be recorded 

30 in just the same image reproduction control data record- 
ing format as that defined by the Video-CD standard or 
in a different recording format. 

In Fig. 19. passwords are defined as conditions for 
use of respective image reproduction control data. 

35 Upon input Of a password from the user, the image data 
display control means 505 refers to the image reproduc- 
tion control data management table shown in Fig. 19, 
acquires the name of the image reproduction control 
data con-esponding to the password, reads the con^e- 

40 spending image reproduction control data from the PC 
data recording area 105 of the optical disk medium 101, 
and stores it into the image reproduction control data 
storage means 504. Although in this emtxxiiment a 
password input by the user is used as a condition for 

45 using the image reproduction control data, other condi- 
tions such as date and time or the like, may be used as 
additional or replacement conditions. In this case, a 
means for checking the date and time is provided within 
the PC 103, and only image reproduction control data 

50 corresponding to the date and time indicated by the said 
means is allowed to be used. 

Rg. 20 shows an example of a display reproduced 
and outputted by the PC 103 in the case of using the 
optical disk medium 101 as a game application. The dis- 
ss play configuration in the PC 103 is the same as in Fig. 
7, with the exception that the keyword display start but- 
ton 712 is not provided in the PC data display window 
702. Output displays 1 and 2 show display examples of 
image data display window 701 and PC data display 
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window 702, respectively. The PC 103, upon receipt of 
the optical disk medium 101 , makes a display in the PC 
data display window 702 which display 2001 requests 
the user to make a password input. For example, this 
password is such that several levels are set for a game 
and that when the user has reached a preset level, a 
next password is shown as an output display to the user. 
The password in question is included in the PC data 
group 1001 and is defined in association with the dis- 
play image at the end of each game level by the image- 
PC data link table. The PC 103 reproduces the image 
data defining the password and at the same time dis- 
plays the password in the PC data display window 702. 
Upon completion of tiie reproduction of the image data 
defining the password, the PC 1 03 erases the display of 
the password. When there is no password input from 
the user, or when an inputted password Input is not 
defined by the image-PC data link table, or when repro- 
duction is made by tiie Video-CD reproducing system 
102, the PC 103 (or the A/ideo-CD reproducing system 
102) starts reproduction from a game start point (open- 
ing) which is at the lowest level. In contrast, when there 
is a correct password input from the user, the PC 103 
starts reproduction from tiie start point of tiie game level 
at which that password is defined. In the former case, 
since no corresponding data is present in tiie image 
reproduction data management table, tiie image data 
display control means 505 starts reproduction in 
accordance with the image reproduction data recorded 
in tiie Video-CD recording area 104. In the latter case, 
the control means 505 locates the corresponding image 
reproduction confrol data from tiie image reproduction 
confol data management table and starts reproduction 
in accordance with the control data thus found out. The 
image reproduction cortrol data defined by tiie pass- 
word recorded in tiie PC data recording area 105 newly 
defines image data not defined in tiie image reproduc- 
tion control data recorded in tiie Video-CD recording 
area 104. Every time a certain level is attained, the 
number of reproduced Image data inaeases. Also, as to 
the control of reproduction made in response to the 
user's operation, the control range is extended and set, 
for example, tiie number of items capable of being 
selected is increased. 

The above operations of tfie PC 103 will be 
explained below with reference Figs. 21 and 22. More 
particularly, Fig. 21 shows a construction example of an 
interactive image reproducing procedure according to 
this embodiment, in which the same components as in 
Fig. 10 are indicated by the same reference numerals 
as in Fig. 10. In Rg. 21, an image reproduction control 
data management table 2101 which defines conditions 
for use of the image reproduction control data is added 
to tiie PC data recording area 105 of tiie optical disk 
medium 101, and password input means 2102 for 
receiving a password input from tiie user is added to the 
PC 103. 

Fig. 22 is a flowchart showing tiie f bw of operations 
of ttie image data display control means 505 after inser- 



tion of the optical disk medium 101 into tiie PC 103 until 
the start of reproduction. More particularly, when the PC 
103 receives tfie optical disk medium 101, tiie image 
data display control means 505 executes the reproduc- 

5 ton application 1003 (step 2201) and makes a display in 
ttie PC 103 requesting the user to Input a password 
(step 2202). Next, upon receipt of a password irput from 
tiie user, the control means 505 refers to tiie image 
reproduction control data management table 2101 (step 
10 2203), and if ttie received password Is one defined in 
tiie management table 2101 (step 2204), the control 
means 505 stores the image reproduction confrol data 
502 corresponding to that password into ttie image 
reproduction confrol data storage means 504 (step 

IS 2205). When tiie received password is one not defined 
by the management table 2101, ttiat is. when an errone- 
ous password has been input (step 2204), or when 
ttiere is no password input (step 2202). the confrol 
means 505 stores the image reproduction confrol data 

20 recorded in the Video-CD recording area 104 into tiie 
image reproduction confrol data storage means 504 
(step 2206). Subsequent operations are the same as 
tiie operations of steps 11 02 et seq. in Fig. 1 1 . 

Altiiough in the above description of tills embodl- 

25 ment ttie optical disk medium 101 is used as a game 
application, the same optical disk medium may be used, 
for example, as an education application for course 
learning. In this case, it is possible to let a higher grade 
of problems appear upon attainment of certain marks as 

30 a result of having solved the problems recorded in tiie 
optical disk medium 101 . It is also possible to first make 
a display urging the user to select a course (not a pass- 
word input) in ttie PC 103, and change tiie reproduction 
control method on the basis of the user's desire. 

35 Further, one image may be divided into a number of 
components, and image data an-anged in a random 
order may be recorded in the Video-CD recording area 
1 04, and reproduced in a correct order by any one of tiie 
image reproduction confrol data 502. 

40 Rg. 23 Shows a configuration example of an inter- 
active image recording/reproducing system to which tiie 
present invention is applied. More particularly, in Rg. 
23. a CD-ROM is used as an interactive image record- 
ing medium 2301 and is configured to include a Video- 

45 CD data recording area 2305, an HTML data recording 
area 2306 and a PC data recording area 2307. Interac- 
tive image reproducing means 2302 reproduces data to 
ttie user from the interactive image recording medium 
2301. For example, ttiere is used a personal computer 

so equipped witii a CD-ROM reproducing function, MPEG 
data reproducing function, reproduction confrol execut- 
ing function conforming to a basic Video-CD standard, 
communication function, WWW browser function for 
controlling reproduction by interrupting a file of HTML 

55 format. Interactive image transmitting means 2304 com- 
municates with the interactive image reproducing 
means 2302 through communication means 2303 (e.g., 
cable, modem, etc.), and returns appropriate HTML 
data in response to ttie URL required by tiie interactive 
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image reproducing means 2302. This interactive image 
transmitting means 2304 is called generally a WWW 
server. At this time, the communication means 2303 
may be a medium using a telephone line and PPP pro- 
tocol in combination, a medium using Ethernet and 
TCP/IP protocol in combination, or another medium 
using another system, provided that the medium is 
capable of transmitting the URL and the HTML data. 

Description will be directed below to a concrete 
interactive image recording/reproducing system. More 
particularly, Fig. 24 shows an example of a file structure 
in the interactive image recording/reproducing medium 
2301 in a form of a hierarchy directory. In the drawing, 
according to the directory structure, recording is made 
taking into consideration the ISO 9660 standard. In the 
tree structure, for an identifier of each node portion, a 
directory name is bracketed ((,)), while a file name is 
shown without brackets. For example. (ROOT)indicates 
a root directory which includes some subdirectories, 
and PBC.DAT stands for a single certain file. The Video- 
CD data recording area 2305. the WWW data recording 
area 2306 and the PC data recording area 2307 shown 
in Fig. 23 correspond to areas 2401. 2402 and 2403, 
respectively, which are enclosed with dotted lines in Fig. 
24. 

The structure of a directory and a file recorded in 
the Video-CD data recording area 2305 is defined by a 
basic Video-CD standard, which standard defines that 
necessary files should be recorded taking into consider- 
ation the ISO 9660 standard. The structure in question 
comprises a directory ( (VIDEO )in the figure) for record- 
ing MPEG image data (e.g. VIDEO001.DAT and 
VIDEO002.DAT in the same figure), a directory 
(<MENU>) for recording MPEG image data (e.g. 
MENU001.DAT and MENU002.DAT) used in such an 
application as a menu, and a directory (<PBC)) for 
recording the image reproduction control data 
(PBC.DAT) describing a file reproduction procedure. 
The file names and directory names depicted in the fig- 
ure are not the same as those defined by the basic 
Video-CD standard. They are names simply used for 
convenience. Further, they do not show all of the files 
defined by the same standard. 

On the other hand, the WWW data recording area 
2306 is an area newly added in the present invention, 
and is provided in a directory named (WWW). The 
WWW data recording area 2306 includes a directory 
((HTML)in Fig. 24) for recording text files (INDEX.HTM, 
PAGE001.HTM and PAGE002.HTM) which are 
described in HTML fornnat. and a directory ((GIF)) for 
recording image data (MENU001.GIF and 
MENU002.GIF) referred to by the file of HTML format. 
The contents of the files of HTML format recorded in the 
directory (MHTML) includes character data related to 
the image data recorded in the Video-CD recording 
area 2305, image file names for displaying the image 
data stored In the directory (GIF)and link data for data 
to be represented to the user when the user makes a 
menu selection or the like. Further, the file recorded in 



the directory (GIF )may be image data format capable of 
being displayed by the WWW browser. 

The PC data recording area 2307 Is an area newly 
added in the present invention and is constituted by a 

5 directory designated (PCAP)and a file AUTORUN.INF 
directory recorded in the root directory In this area, pro- 
grams necessary for reproducing the interactive image 
recording medium 2301 of the present invention by the 
personal computer, and program starting procedures 

10 are both recorded. 

Description will be directed below to the procedure 
for reproducing the interactive image reproducing 
medium 2301 of the present invention using a basic 
Video-CD reproducing system with reference to Figs. 

15 25a-b. More particularly Figs. 25a-b show an exanrple 
of a portion of the image reproduction control data 
(PBC.DAT in Fig. 24). The described contents of the 
image reproduction control data are defined by the 
Video-CD standard. This standard prescribes a repro- 

20 duction procedure describing unit for image data (one or 
plural) con-esponding to user operations or various 
events. In the present invention, the reproduction unit is 
expressed as a node. The image reproduction control 
data comprises plural nodes having independent node 

25 numbers, and describes a reproduction procedure for 
each node. 

More specifically. Figs. 25a and 25b are examples 
showing reproduction procedures for node numbers 1 to 
4 on the assumption that titles are prepared for cooking 

30 ethnic dishes. Rg. 25a first displays the image data 
(MENU001 .DAT) of the node number 1 as a display win- 
dow 2501. The display requests the user to select the 
node number 1 , 2 or 3. The contents in response to the 
user's operation is described in the node number 1 in 

35 Fig 25b. For example, in the case where the user 
selects the node number 1 (KEY 1) in reproducing the 
image data MENU001.DAT of the node number 1, link 
destination is shifted to the node number 2. When the 
user selects RETURN, the link destination is not 

40 defined, that is. no response occurs. 

When the user selects the node 1 while displaying 
the display window 2501, shift is made to the node 2 
and the image data VIDEO001 .DAT is reproduced in the 
display window 2502. According to the description of 

45 the node 2 in Fig. 25b, when the user selects RETURN, 
shift is made to the node number 1 (display window 
2501) again. 

As described above, the interactive image record- 
ing/reproducing medium 2301 is reproduced with the 

50 conventional Video-CD reproducing system using the 
data recorded in the Video-CD recording area 2305. 
thereby innplementing an interactive image reproducing 
operation. Although the file to be reproduced is desig- 
nated in ternns of file name in the figure, a system may 

65 be adopted for directory describing a file address if the 
system can specify the file. 

Rg. 26 shows a reproduction procedure of the inter- 
active image recording medium 2301 of the present 
invention with the WWW browser. More particularly, a 
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display window 2601 is in a state that the WWW 
browser opens the file INDEX. HTM recorded in the 
directory (HTMDin the directory (WWW). The display 
window includes an area for displaying a function button 
2605 operating page-turning of the browser, an area for 5 
displaying the HTML data and a scroll bar 2606 for 
scrolling operation of the window in the case that the 
volume of the HTML data is large. The contents of 
INDEX.HTM conforms to the HTML standard and an 
example thereof will be described with reference to Rg. 10 
27a. According to the HTML format, the image data is 
displayed by designating the file name by the portion 
of <IMG SRC = ). When the image is selected by 
the user and shift is to be made to any page. <MG SRC 
= '•...">is sandwiched between <A HREF = "...•'>and (/A} 75 
and the page name to be shifted to is designated by the 
portion of (A HREF = "„,">. In Fig. 27a the file 
INDEX.HTM is opened, the image file MENUOOI.GIF is 
displayed and then the image file KEY1.GIF is dis- 
played. ^ 

As is apparent from comparison between the dis- 
play window 2601 of Rg. 26 and the display window 
2501 of Rg. 25a, the imagedataMENU001.GIF has the 
same image pattern as that of MENU001.DAT In the 
display window 2601 . there are displayed selection but- 25 
tons 2607 to which numbers [1], [2] and [3] are allocated 
for receiving user's selection operations respectively, 
and in addition, the MENUOOI.GIF KEY1.GIF and 
KEY2.GIF are used for the display data for the selection 
buttons 2607 (the recording areas for KEY.1GIF and 30 
KEY.2GIF are not illustrated in the figure, but is 
assumed to be in the <GIF>of the WWW data recording 
area 2306). 

In the display window 2601, when the user selects 
the selection button 2607 [1 ], shift is made to the corre- 35 
spending page PAGE001.HTM file as illustrated in dis- 
play window 2602. The contents of PAGE001 .HTM is as 
shown in Fig. 27b. The file name of the image data to be 
displayed at the beginning is VIDEO001.GIF Further, 
definition has been made for subsequently displaying 40 
how to cook "Ethnic Curry" as character data. Moreover 
definition has been made for finally displaying the selec- 
tion button linked to the file INDEX. HTM (in the figure 
the image data of the name RETURN.GIF is allocated.). 
Again, when the WWW browser opens the file 45 
PAGE001.HTM of HTML format, the display window 
2602 appears. As apparent from comparison between 
the display window 2602 of Fig. 26 and the display win- 
dow 2502 of Fig. 25a, the image data VIDEO001.GIF 
has the same pattern as that of VIDEO001 !daT so 

On the other hand, in the display window 2601, 
when the user selects the selection button [3]. shift is 
made to the corresponding page PAGE003.HTM file. 
The contents of PAGE003.HTM is as shown in Rg. 28a. 
In the page, there are displayed the image data ss 
MENU002.GIF, the image data for the selection buttons 
RETURN.GIF and NEXTGIF. and character data 
"Order: $200". and these data constitute the display 
window 2603. In PAGE003.HTM of Fig. 28a. a URL 



address is defined as a page shifted to on selection of 
the character 2608 "Order: $200" by the user. In the 
same figure, access is made for the WWW server of the 
name www.ethnic.xxx.xxx using HTTP protocol, and 
definition is made to open the file order1.htm of HTML 
format stored in the server. 

In the display window 2603. when the user selects 
"Order: $200" shift is made to the conresponding page 
orderl .htm file. The contents of onderl .htm is as shown 
in Fig. 28b. The contents to be displayed at tiie begin- 
ning is displayed with an underline, that is, characters 
"Order for spices" sandwiched between (U>and (AJl 
Subsequently, the image file SPICE1.GIF and charac- 
ters "Cumin" are displayed in accordance with the 
description of line 2702. In the description of line 2703, 
the form input function of HTML is made to be used. 
This means that when the user selects the desaiption 
<iNPUT TYPE = "submit"...) of line 2705, the WWW 
browser transfers the form input contents to the pro- 
gram post-query of www.ethnic.xxx.xxx which is the 
WWW server. As for tiie form input contents, the text 
field (INPUT TYPE = "text"... >for inputting a member ID 
is defined in line 2704, and the WWW browser displays 
tile text input field. When the WWW opens the file 
order1.htm of HTML format, tiie display window 2604 
appears. When tfie user inputs the member ID into tfie 
text input field and selects a confirmation button 2610, 
tiie WWW browser fransmits ttie member ID to ttie 
WWW server. The WWW server confirms the received 
member ID, accepts the ordering and transmits HTML 
data which is the same data as PAGE003.HTM as ttie 
page to be next displayed. As a result, tiie WWW 
browser displays ttie display window 2603 again. 

In tiiis embodiment altiiough the image file 
SPICE1.GIF is displayed in accordance with tiie 
description of line 2702. the image file may be transmit- 
ted from the WWW server, or may be used by storing in 
advance ttie file SPICE1.GIF into the same directory 
hierarchy of ttie interactive image recording medium 
2301. Generally when tiie WWW browser uses such 
image file, the image file is obtained in reference to tiie 
recorded area of the displayed file of HTML format. In 
ttiis embodiment, ttie file order1.htm of HTML format is 
obtained from ttie WWW server, therefore SPICE1 .GIF 
is also obtained from ttie WWW server. Accordingly for 
display using SPICE1.GIF recorded in advance into ttie 
interactive image recording medium, the WWW browser 
is used having the function of retrieving whetiier or not 
the same file is present in the interactive image record- 
ing medium 2301 before obtaining the image file form 
ttie WWW server. TTie WWW browser having such func- 
tion is preferably recorded in ttie PC data recording area. 
2403 in Rg. 24 as WWWVIEW.EXE and used on 
demand. Fuilher, the function of directory displaying 
files in ttie Video-CD data recording area (files in 
(VIDEO > (MENU >) of ttie WWW browser dispenses witfi 
recording of ttie image file of the same pattern in ttie 
directory (WWW>-(GIF>. resulting in an increase in 
recording efficiency 
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As the contents of AUTORUN.INF recorded in the 
PC data recording area 2403, one line such as "open" s 
"PCAPVSTARTUREXE" is added and when the interac- 
tive image recording medium 2301 is recorded, the 
interactive image recording medium 2302 refers to the 5 
contents of the AUTORUN.INF to execute STAR- 
TUREXE. As the contents of STARTUREXE, the user 
selects whether to perform recording using the Video- 
CD or perform recording as the WWW browser using 
the communication function. For the Video-CD. the pro- ro 
gram VCDVIW.EXE recorded in the PC data recording 
area 2403 is executed whereas for the WWW browser, 
the program WWWVIEW.EXE recorded in the PC data 
recording area 2403 is executed. 

As described above, in the interactive image is 
recording medium 2301 since the recording medium 
reproduces the Video-CD image and the text data linked 
to the image data in the Video-CD recording area 2305 
can be recorded in the HTML data recording area 2306, 
the browser can reproduce l3oth data. Further, since the 20 
file contents of HTML format can be recorded in the 
HTML data recording area 2306. and description can be 
made to shift to the HTML file in the WWW server con- 
nectable through the communication means, it is made 
possible to provide latest (e.g., updated) data to the 25 
user which is not provided in the package medium such 
as the CD-ROM. 

In addition, since all of file contents of HTML format 
is provided from the WWW server, description is made 
to use the image file recorded in advance in the interac- 30 
tive image recording medium 2301 and the WWW 
browser having the function of using the image file on 
demand is recorded in the same interactive image 
recording medium 2301 , and it is possible to display the 
image file without fransferring the image file through the 35 
communication means, thereby improving the image 
displaying speed. 

In the above embodiments, although an optical 
disk, or CD-ROM is used as the interactive image 
recording medium 2301 . any recording medium may be 40 
employed, for exarr^le, a magnetic recording system, 
semiconductor recording system or the like. Although 
the description has been made for the case using the 
interactive image recording system based of the Video- 
CD standard, any interactive image recording system 45 
may be used provided that the definition is made for the 
image data and the reproduction control data. Although 
the image data ((VIDEO )<MENU)ln Fig. 24). the image 
reproduction control data ((PBOin Fig. 24), the image 
related data (<WWW) in Fig. 24) and the PC data so 
((PCAP)in Fig. 24) are recorded on a single medium, 
the PC data may be recorded in another medium. 

Although the atx>ve-described exemplary directory 
structure is in conformity with the ISO 9960 standard, 
another file system may be employed. Further, it is not ss 
necessary to use a the directory structure having inde- 
pendent areas as (PCB>. (VIDEO). (MENU), (WWW) 
and (PCAP). 

Although the MPEG compression system is used 



as explaining the image data, other systems may also 
be employed. In this case, the interactive image repro- 
ducing means 2302 is preferably provided with repro- 
ducing means correlated to the image data. 

As the reproducing means, the personal computer 
is used, however, any reproducing means may be used 
as long as provided with a Video-CD reproducing 
means and a WWW browser function. 

In the interactive recording/reproducing system 
according to the present invention, as set forth herein- 
above, since upon operation input from the user a con-e- 
sponding reproduction procedure is acquired from the 
image reproduction control data, followed by reproduc- 
tion of image data in accordance with the reproduction 
procedure, it is possible to effect an interactive repro- 
duction. In addition, since image data and image related 
data are defined in a correlated manner by the relation 
defining information, and since image data, image 
reproduction control data, image related data and rela- 
tion defining information are recorded on a single 
recording medium, it is possible to reproduce not only 
image data, but also image related data (e.g., ASCII text 
data) related to the image data being reproduced, 
whereby it becomes possible to include a large amount 
of information at a reduced data volume. 

Further, using the functions of communication, 
printing and calculation which are unique to a personal 
computer, it is possible to combine image data with 
information controlled by the personal computer and 
make an order for commodities in mail order, printing of 
a collection of problems and simulation. 

Additionally, since the interactive recording/repro- 
ducing method in question can have a plurality of image 
reproduction control methods, it is possible to select a 
reproducing metiiod suitable for an intended use and 
hence possible to extend the interactive operation. 

Further, since image related data related to image 
data such as character data and external information 
defining data for obtaining multimedia data tiirough 
communication means are recorded in the same 
recording medium togetiier with Image data and image 
reproduction control data, in relation to interactive 
image data supplied through a package medium such 
as an optical disK data can be supplied through a net- 
work. 

in tiie above-described embodiments, and espe- 
cially in implementations of a sensitive or confidential 
nature, it is desirable that the image reproduction con- 
trol data management table be recorded in encryption 
form. i.e.. in order to resist tampering therewitii. 

Although in the above-described embodiments a 
text character sti-ing is used as password, there may be 
used any other password form, e.g.. numerical pass- 
words, magnetic password card, etc. Further, although 
in tills embodiment each password is given to tiie user 
by simultaneous display witti image reproduction, there 
may be adopted any other method. For example, in the 
case where plural image reproduction control data are 
given to tiie user by a management or accounting 
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department a password may be given to the user at an 
appropriate time. e.g.. at initiation of employment. 

This concludes the description of the prefen-ed 
embodiments. 

Although the present invention has been described s 
with reference to a number of illustrative embodiments 
thereof, it should be understood that numerous other 
modifications and embodiments can be devised by 
those skilled in the art that will fall within the spirit and 
scope of the principles of this invention. More particu- io 
larly, reasonable variations and modifications are possi- 
ble in the component parts and/or an-angements of the 
discussed combination an-angements within the scope 
of the foregoing disclosure, the drawings and the 
appended claims without departing from the spirit of the is 
invention, e.g., the following represents a non-exhaus- 
tive list of modifications which might readily be apparent 
to one skilled in the art to which the present invention is 
directed. 

According to this embodiment, as explained above, 20 
it is possible to record a plurality of image reproduction 
control data in the optical disk medium 101, whereby it 
is made possible to realize an interactive reproduction 
of image according to an intended use. Although the 
descriptions of the above embodiments premise the use 2s 
of an optical disk medium 1 01 . the same effect as above 
is obtainable also by the adoption of another recording 
method as long as such method adopted permits an 
interactive image reproduction. Further, although an 
interactive image reproduction method taking the 30 
Video-CD standard into consideration has been used in 
the above descriptions, there may be used another 
reproduction control method. 

As a further possible alteration, although it has 
been described above that an image data, image repro- 35 
duction control data, PC data, image-PC data link table, 
and reproduction application, are recorded in the same 
recording medium, the reproduction application may be 
recorded in another recording medium. Additionally, 
although it has been mentioned above that the directory 40 
structure of Fig. 2 conforms to ISO 9660. this does not 
constitute any limitation to the present invention if there 
is used any other recording method other than the 
method using an optical disk. Further, although it has 
been explained that all directories and files lie in the 45 
same route, it is not always necessary to do so if it is 
possible to manage the reproduction application in a dif- 
fering structure. The directory and file names are not 
basic to those shown in Fig. 2. Also, it is not always nec- 
essary for the image-PC data link table to take the form so 
of Fig. 8. For example, without designating text data in 
terms of the name of file, there may be used a data base 
with text data per se recorded therein. Even if keywords 
and text data are defined their related information using 
separate tables, there will be obtained the same effect ss 
as above. 

As yet further possible variations, although in the 
above embodiments the PC data has been described 
as text data, there may be adopted another data form. 



For exanple. according to another data fonn which may 
be adopted, object data or the like for simulation are 
recorded as PC data and a calculating function for mak- 
ing a three-dimensional display of the object is inrparted 
to the image data display control means, whereby the 
user can see a simulation image of the object on the PC 
data display screen while looking at a commentary on 
the image. Additionally, although it has been described 
above that an entirety of the image reproduction control 
data and image-PC data link table are read out and 
recorded during a single operation, only a portion 
thereof may be read out and recorded as necessary. In 
tiiis case, the PC need not have storage means for stor- 
ing each data. Further, alttiough the image data has 
been described above as data compressed in accord- 
ance witii the MPEG standard, the image data may be 
such data as has been compressed by another com- 
pressing method. In this case, tiie image data decoding 
means has a decoding function correspondingly to tiie 
image data compressing metiiod adopted. 

What is claimed and desired to be secured by tiie 
Letters Patent of the United States is: 

Claims 

1 . An information medium comprising: 

first image data; 

first image related data related to contents of 
the first image data; 

first image reproduction control data for ena- 
bling reproduction of tiie first image data in 
accordance with tiie first image related data; 
second image related data related to tiie con- 
tents of the first image data; and 
relation defining information defining at least a 
relation between tiie second image related 
data and the first image data, so as to enable 
reproduction of tiie first image data in relation 
to the second image related data. 

2. A medium as claimed in claim 1 . further comprising: 

second image reproduction control data for 
enabling reproduction of the second image 
related data in relation to the first image data 
witii reference to said relation defining informa- 
tion. 

3. A medium as claimed in claim 1 , wherein: 

said first image data is more specifically 
video image data; 

said first image related data is more particu- 
larly static image data useable for reproduction on a 
video-CD player; and 

said second image related data is more par- 
ticularly at least one of coded text data, picture 
data, addressing data and Internet link data directiy 
useable for reproduction on a personal conputer. 
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4. A medium as claimed in daim 3. wherein: 

a combination of said first image data and 
said first Image related data represents first interac- 
tive multimedia information useable for interactive 
reproduction on said video-CD player; and 

a combination of said first image data and 
said second image related data represents second 
interactive multimedia information useable for inter- 
active reproduction on said personal computer. 

5. A medium as claimed in dalm 4, wherein: 

said first interactive multimedia information 
conforms to a Video-CD standard; and 

said first interactive multimedia information 
and said second interactive multimedia information 
are recorded in accordance with an ISO 9660 
standard. 

6. A medium as claimed in daim 1 . wherein: 

said relation defining information more par- 
ticularly defines a relation between the second 
image related data, the first image data and the first 
Image related data, so as to enable reproduction of 
the second image related data, the first image data 
and the first image related data in relation to one 
another. 

7. A medium as claimed in dalm 1 , wherein: 

said first image reproduction control data 
more particularly comprises a plurality of different 
reproduction control data accessible in accordance 
with at least one of a date, time and password, each 
reproduction control data allowing reproduction of 
the first image data in relation with the first image 
related data only upon at least one of a respective 
date, time and input of a valid password. 

8. A medium as claimed in claim 1 , further comprising: 

keyword information indicating contents of said 
second image related data. 

wherein said relation defining Information 
includes information indicating correspondence 
between said second image related data and said 
keyword information. 

9. A medium as claimed in daim 1 , wherein: 

said first image data includes commodity 
introducing image data introducing commodities for 
sale, and 

said first image related data indudes com- 
modity information pieces of at least one of a name, 
number, price, color and size of each of the com- 
modities introduced by said commodity introducing 
image data, and further includes communication 
procedure information pieces of at least one of a 
communication address and communication proto- 
col for communication with a commodity order 



center which receives orders for commodities intro- 
duced by said commodity introducing image data. 

1 0. A medium as claimed in claim 1 , further comprising : 

5 

operation input means which performs a repro- 
ducing operation for said first image data in an 
interactive manner; 

image data reproducing means which receives 
10 an operation instruction from said operation 

input means, acquires a corresponding repro- 
duction procedure from said first image repro- 
duction control data, and reproduces said first 
image data in accordance with said reproduc- 
15 tion procedure; and 

image related data reproducing means which 
acquires and reproduces said first image 
related data related to said first image data 
being reproduced on a basis of said relation 
20 defining information. 

11. A medium as claimed in claim 1 , further comprising : 

operation input means which performs a repro- 
25 ducing operation for said first image data in an 

interactive manner; 

image data reproducing means which receives 
an operation instruction from said operation 
input means, acquires a corresponding repro- 
30 duction procedure from said first image repro- 

duction control data, and reproduces said first 
image data in accordance with said reproduc- 
tion procedure; and 

image related data reproducing means which 
35 acquires and reproduces said first image 

related data related to said first image data 
being reproduced on a basis of said relation 
defining information, 

40 wherein said image related data reproducing 

means is provided with keyword input means for 
input of said keyword information, and receives said 
keyword information through said keyword input 
means, acquires from said relation defining infor- 
45 mation. said inrage related data corresponding to 
said received keyword Information, and then repro- 
duces at least one of an acquired first image related 
data and first image data. . 

so 12. A medium as claimed In claim 1 1 , further compris- 
ing: 

printing means for printing said first image 
related data and said first image data in combi- 
65 nation with each Other. 

13. A multi-media information medium comprising tiier- 
eon: 
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first image data; 

first image related data related to contents of 
the first image data: 

first relation defining information defining a 
relation between the first image related data s 
and the first image data; 
first image reproduction control data for ena- 
bling reproduction of the first image data in 
accordance with the first image related data; 
second image related data related to the con- io 
tents of the first image data; and 
second relation defining infornr^tion defining at 
least a relation between the second image 
related data and the first image data. 

IS 

14. An information medium for facilitating visual repro- 
duction of information on at least two differing types 
of reproduction apparatus using at least a portion of 
image data in common, said medium comprising: 

20 

first image data; 

first image related data related to contents of 
the first image data, said first image related 
data useable for reproduction on a first repro- 
duction apparatus of a first type; 2S 
first image reproduction control data for con- 
trolling reproduction of the first image data in 
relation with the first image related data on said 
first reproduction apparatus of said first type; 
second image related data of a type different 30 
from a type of said first image related data, and 
being related to the contents of the first image 
data, said second image related data useable 
for reproduction on a second reproduction 
apparatus of a second type different from said as 
first type; and 

relation defining information defining at least a 
relation between the second image related 
data and the first image data, so as to define 
reproduction of ttie first image data in relation 40 
to the second image related data on said sec- 
ond reproduction apparatus of said second 
type. 

15. A medium as claimed in claim 14, furtiier compris- 4S 
ing: 

second image reproduction control data for 
controlling reproduction of the first image data 
in relation with the second image related data so 
on said second reproduction apparatus of said 
second type, witii reference to said relation 
defining information. 

16- A medium as claimed in daim 14, wherein: ss 
said first image data is more specifically 
video image data; 

said first image related data Is more particu- 
larly static image data useable for reproduction on a 



video-CD player; and 

said second image related data is more par- 
ticularly at least one of coded text data, picture 
data, addressing data and Internet link data directiy 
useable for reproduction on a personal computer. 

17. A medium as claimed in claim 16. wherein: 

a combination of said first image data and 
said first image related data represents first interac- 
tive multimedia information useable for interactive 
reproduction on said video-CD player; and 

a combination of said first image data and 
said second image related data represents second 
interactive multimedia information useable for inter- 
active reproduction on said personal computer. 

18. A medium as claimed in claim 1 7, wherein; 

said first interactive multimedia information 
conforms to a Video-CD standard; and 

said first interactive multimedia information 
and said second interactive multimedia information 
are recorded in accordance with an ISO 9660 
standard. 

19. A medium as claimed in claim 14. wherein: 

said relation defining information more par- 
ticularly defines a relation between the second 
image related data, the first image data and tiie first 
image related data, so as to enable reproduction of 
tiie second image related data, the first image data 
and the first image related data in relation to one 
another. 

20. A medium as claimed in claim 14, wherein: 

said first image reproduction control data 
more particularly comprises a plurality of different 
reproduction confrol data accessible in accordance 
witii at least one of a date, time and password, each 
reproduction control data allowing reproduction of 
the first image data in relation witfi tiie first image 
related data only upon at least one of a respective 
date, time and input of a valid password. 

21. A medium as claimed in claim 14. further compris- 
ing: 

keyword Information indicating contents of said 
second image related data, 
wherein said relation defining information 
includes information indicating conrespond- 
ence between said second image related data 
and said keyword information. 

22. A medium as claimed in claim 15, wherein: 

said medium is more specifically a CD-ROM; 

said first image related data is more particu- 
larly useable for reproduction on a video-CD player; 
and 

said second image related data is more par- 
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ticularly useable for reproduction on a personal 
conputer. 

23. A reproduction system comprising: 

a CD-ROM medium as claimed in claim 22; 
a video-CD player arranged for receiving said 
first image data, said first image related data 
and said first image reproduction control data 
from said CD-ROM medium, and for perform- 
ing visual reproduction of the first image data in 
relation with said first in^ge related data in 
accordance with said first image reproduction 
control data; and 

a personal computer arranged for receiving 
said first image data, and said second image 
related data from said CD-ROM medium, and 
for performing visual reproduction of the first 
image data in relation with said second image 
related data In accordance with said second 
image reproduction control data. 

24. A reproduction system as claimed in claim 23, 
wherein: 

said medium includes, as said first image data, 
commodity introducing image data which intro- 
duces commodities for sale, and as said first image 
related data, commodity information pieces includ- 
ing at least one of a name, number, price, color and 
size of each of the commodities introduced by said 
commodity introducing image data, and further 
includes communication procedure information 
pieces of at least one of a communication address 
and communication protocol for communication 
with a commodity order center; and further com- 
prising: 

communication means fa making communica- 
tion with the comnfKxJity order center which 
receives orders for the commodities introduced 
by said commodity introducing image data, and 
said image related data reproducing means 
transmits said commodity information pieces 
from said communication means to said com- 
modity order center in accordance with said 
communication procedure information. 

25. A reproduction system as claimed in claim 23. 
wherein: 

at least one of said video-CD player and said 
conputer obtains, from outside said reproduction 
system using communication means, third image 
related data and external information defining data 
defining a relationship of said third image related 
data and said first image data. 

26. A reproduction system as claimed in claim 25. 
wherein: 

said relation defining Information is recorded 



as a file of a HTML (Hyper Text Markup Language) 
format. 

27. A reproduction system as claimed in daim 26. fur- 
5 ther comprising: 

a reproducing program for reproducing said 
third image related data with reference to said 
file of HTML format. 

10 



15 



20 



25 



30 



35 



40 



45 



50 



17 



EP 0 762 422 A2 




ROOT' 



FIG. 2 



4- <VIDEO> 



<PBC> 



<MENU> 



-r <PC> 



PBC. DAT 

VIDEO. 001 
VI DEO. 002 
VI DEO. 003 

MENU. 001 
MENU. 002 
MENU. 003 



— PCLINK.TBL 

- INFOFILE.001 
— INFOFILE.002 



M04 





h <PCAP> 1 

L _ 


VIDEOCD. EXE 



-105 



-106 



18 



EP 0 762 422 A2 



FIG. 3a 



NODE NUMBER 1 

IMAGE DATA MENU. 001 


EVENT 


CORRESPONDING 
NODE NUMBER 


PREVIOUS 




NEXT 


2 


RETURN 




SELECT 1 


3 


SELECT 2 


4 


REPRODUCTION 
END 


1 



FIG. 3b 



NODE NUMBER 3 

IMAGE DATA VIDEO. GDI 


EVENT 


CORRESPONDING 
NODE NUMBER 


PREVIOUS 




NEXT 


4 


RETURN 


1 


REPRODUCTION 
END 


4 



FIG. 4 



USER' S 
OPERATION 



REPRODUCTION START 



KEY INPUT OF SELECT 1 



OUTPUT 
DISPLAY 



UNIT 1 

1. Lesson 1 

2. Lesson 2 



401 




BNSDOCID: <EP__jD762422A2JL^ 



19 



EP 0 762 422 A2 



FIG. 5 



101 



501 



IMAGE DATA 
GROUP 



502 



IMAGE 

REPRODUCTION 
CONTROL DATA 



VIDEO-CD AREA 




503 
__L- 



OPERATION INPUT 
MEANS 



505 
_JL. 



IMAGE DATA DISPLAY 
CONTROL MEANS 



504 



506 

< 




507 


IMAGE DATA 




IMAGE DATA 


DECODING 




DISPLAY 


MEANS 




MEANS 



IMAGE REPRODUCTION 
CONTROL DATA 
STORAGE MEANS 



FIG. 6 



C START ) 



STORING OF IMAGE REPRODUCTION 
CONTROL DATA 



J-601 



TRANSFER OF REPRODUCTION FILE 
SPECIFIED BY THE FIRST NODE 



-602 




BNSOOCID: <EP_jD7e2422AajL> 



20 



EP 0 762 422 A2 



FIG. 7 



703- 



□ 



701 
-J 




Good morning ! 



705-j iiU|3|4|6|6iT|e|9|o| 



706 707 / 709 

708 710 



n 



1 



712 



702 
_i 



How to greet 



Morning greet i ng : 
Good Morning. 

Afternoon greeting : 
Good afternoon. 

Evening greet ing : 
Good evening. 



FIG. 8 



IMAGE FILE 


TEXT DATA 


KEYWORD 


VIDEO. 001 


INF0FILE.001 


HOW TO GREET 


INFOFILE. 002 


HOW TO ANSWER 


INF0FILE.003 


HOW TO SELF- 
INTRODUCE 


VIDEO. 002 



























BNSOOCID: <EP__a762422A^J^ 



21 



EP 0 762 422 A2 



O LlJ 
Z CD 

o 

o o 

LULUZ 




>- 
-J 

O 

— o 

OOO 

— |>-^- 
uJUJ:^ 



>--j 

LULU 



O 
ID 

Oh- 
OCQC 

Qc cn 



LULiJ 
COO. 

= o 





c c 
o o 

(0 CO 



£3 











• 
• 

u 


C c " 
CD — O W 
C W o C » 
» C • c c 




to 


+» — • 4. » 
« C 1. « « c 
9 W 9 4^ « 0 




• 

o 


O ^ k. >. 
Q C C a CD 9 

o 






CD ^ O BD 
c o C o C O 


□ 


H 


» O a. o — o 

C (3 • O C C9 
1. « 

o > 
X •< Ui 





Csl 
0.0. 

^ — 



BNSOOCID: <EP__j0762422Aaj_> 



22 



EP 0 762 422 A2 



CO 



<:>- 

O — UJ 








CO 




o 


o 


to 


7 


lEANS 




CO 

3 








1— S 




>UT 




O 

LUC? 

z 








CO — 








OH- 

-< 












o 




11 












^— 




<:cr 




<: 

QC 
LU 




GCO 
LUC/) 

Q_ 




Q- 
O 









CO 



o 
in 



a. 

CO 

— 00 



o 
Lua: 

<cz 
so 
— o 



o 
cc 



8 

zco 
oz 

P5 

O LU 

oc<< 

O-CC 
LU O 

LU 



— O 



o 

O.LU 
I CD 
LU<C 
C5I QC 

<o 

— CO 



o 

-J 
o. 

-< 

CO 

IS 

i^z 
o 

raiu 
o CJ 
o<c 
occr 
o-o 

tJJH- 

cr CO 



LO 
LO 

















































o 


















ROU 




CTI 




)UP 




^TA 




o z 






e> 
«c 




Of- 




GR( 




TABLE 




— o 
»— — 

O 1— 






DAT 




QC^C 
O-O 
LU 




JA 






o o 
o — 






AGE 




GE R 
TROL 






cvj 


C9^ 


CO 


REPR 
APPL 

m 1 ki 








CsJ 


'<Z 












o-' 




zo 
— o 






o , 
o 




|- 






iO 




LO 





































BNSOOCID: <EP_0762422A2J^ 



23 



EP 0 762 422 A2 



FIG. 11 



( ^'f' ) 



LOADING OF 

REPRODUCTION 

APPLI CATION 



STORING OF IMAGE 
REPRODUCTION 
CONTROL DATA 



STORING OF IMAGE-PC 
DATA LINK TABLE 



TRANSFER OF 
REPRODUCTION FILE 
SPECIFIED BY THE 
FIRST NODE 



DISPLAY OF PC DATA 
DISPLAY WINDOW 

1 



knoi 

-601 

-1 1 02 
-1103 




ERASING OF PC DATA 
DISPLAY WINDOW 



Ml 06 




PC DATA 



IDEO-CD DA 



1108 



605- 



REFER TO IMAGE 
REPRODUCTION 
CONTROL DATA 


REFER TO 
DATA LINI 


IMAGE- PC 
( TABLE 




1109 


* 


TRANSFER OF 
IMAGE DATA 


DISPLAY OF 
PC DATA 



BNSOOCID: <EP_JD762422A2J^ 



24 



EP 0 762 422 A2 



FIG. 12 



1210 



1205 1206 

^ A- 



1203- 
1202- 



Contents 



Ret r t eve f 



1207 1208 

^V- — A 



>> 



How to greet 




How to greet 




▲ 


How to answer 






How to self- introduce 








▼ 



4 



1209 
_1 



How to greet 



Morning Greeting : 

Good morning. 
Afternoon Greeting : 

Good afternoon- 
Evening Greeting : 

Good evening. 



-1211 



1201 



-1204 



Video-CD 




121 
_L 




Good morning ! 



BN800CID: <£P_J0762422A2JL> 



25 



EP 0 762 422 A2 



CO 




BNSDOCID: <EP_jD7e2422A2JL^ 



26 



EP0 762 422 A2 



CO ! 
2^ 



— CO 

irz 

LUUJ 

cr s 
>-co 

LU — 




CO 


o 


CD 




IX) 








lEANS 




CO 








INPUT 




OBJEC 
ATING 


[RATION 




ERATION 
SCRIMIN 


OPf 







a. 

CO 



LUCO 



CO 

gH CO 



C50 
— o 



LAY 


1006 




ISP 






o 






PC DATA 
MEANS 


o 
o 


ID 

o 




UJ 




z 


-J 




o 








<c 




J— 


1— 




•< 
o 


:^ 










-J 








-J 




AP 


«<co 




CO 






z z 


^*<: 




o <: 


o tu 




— LU 








o 




o 


O-UJ 




3 UJ 


< CD 
















GCo: 






o-o 


— CO 




OC CO 



LO 
iO 



CD 



CJ 



I— 



LU 

CDS*: 
<<z 



CO 



o — 

LUO- 



BNSDOCID: <EP_P762422A2J^ 



27 



EP 0 762 422 A2 



FIG. 15 



( START \ 

I 



LOADING OF REPRODUCTION APPLICATION "T"^ ^01 

j--" J 

502 



STORING OF IMAGE-PC DATA LINK 



TABLE [ ^^ 




ERASING OF KEYWORD RETRIEVAL 
DISPLAY WINDOW 



BNSOOaO: <EP_i)7B2422A2JL> 



28 



EP 0 762 422 A2 



o H-CC 
OOCO.LU 
Z LULUH- 

OOCUJUJ 

o ooco 



CO 



03 



CO' 



CO 

o> 

LO 



CO 



Z 



UJ OCO 
C!3 OZ 



CO 
ocz 

UJ<< 

oz 



GO — 



o — 



O I 



:o 

ICO 



CO 

5 



!28 

UJ !3cO 
CD C-Z 

ii3 



r 

LO 
ID 



»— < 

<:-Jco 

OO-Z 

co<: 
o — UJ 
O-OZ 



CO 



CO 



O UJUJ 

CX.<CUJ 
I I— o 
UJ «c 

<czo 

Z — h- 

— —ICO 



to 



T 



CO 

>z<c 

-OUJ 



<:co 



I 



o 

2 CO 
o^z 

or <cu] 

CL.OZ 

OCD 
UJOC-< 

^zo 



LU 
QC 

oz 
o 
>- — 



— ■<UJ 

ZOL.O 
OOuh- 

cxcco 



CSI 



to 




BNSOOaO: <£P__jD7e2422A?JL? 



30 



EP 0 762 422 A2 



FIG. 18 

( START 



, ._ ' 

EXECUTION 0 
ORDER APPLI 


F COMMODITY 
CATION 




r ■ 


REFER TO IMAGE- PC DATA 
LINK TABLE 






CREATION OF ORDER 
INFORMATION 




f 


TRANSMISSIC 
INFORMATIO^ 


)N OF ORDER 
1 



-1801 



-1802 



-1803 



-1804 



( END ) 



FIG. 19 



IMAGE REPRODUCTION 
CONTROL DATA 


PASSWORD 


PBCl.DAT 


znedos 


PBC2. DAT 


qpda jf 


PBC3. DAT 


ibvrgk 







BNSOOCID: <£P__|)7S2422A2JL> 



31 



EP 0 762 422 A2 




BNSOOCID: <EP_jD7e2422A2JL> 



32 



EP 0 762 422 A2 



CO 



III 



CO 

L 




<c >- 

<C — ICO 

c/><c 

O — LlJ 



CM 



CO 



«C CO 

ocz 

LU <C 

a. uj 
OS 





1— 




o 




LUC? 








GO — 




OH- 








o — 








1 




<cocco 




oc oz 




LU CO'< 




Q. — LU 







CO 

o 



o o 



=3 CO 

o<cz 
oH-<x: 
a:<cuj 
cos 

LU 

OC-JUJ 
OCD 

LiJa:<< 
•<zo 

SOH- 
— O CO 



o 
cc 



I— o 
-< 

lU -J CO 
CD O- Z 

<s:co< 

S — LjJ 



cc 
o 

CO ; 

CO- 
Cl.\ 



in 



CO 



OCQ 

Q- <x: L 

I I— C5 
LU <C 

— —ICO 



LD 



o 



oz 
— o 
I— — 
o»— 

ZD <C LU 

O — <C CO 
OC^QCZ 

Q- a. o «c 
LU a. H- LU 
cr<ccos 



o 
cc 

<3 



C5 



ZD 

o 
cc 
a. 

LU 

cc 

LU 
CD 



o 
cc 



:0 

■ o 



GQ 



0<CH- 
Oh- 

O.OZ 
LU u3 

OUJ 
LUOCCD 
CDH'<C 

<:zz 
zo<< 



O CD 
lU 



oz 
- o 

oo 
o — 
cc - 

LUCu 

oc <: 



CO 



33 



BNSOOCIO: <EP_07e2422A2J_> 



EP 0 762 422 A2 




2201 



REFER TO IMAGE REPRODUCTION 
CONTROL DATA MANAGEMENT 
TABLE 




STORING OF IMAGE 
REPRODUCTION 
CONTROL DATA 





» 




-2203 




NO 








► 








2206 




SELECTION OF DEFAULT 




IMAGE REPRODUCTION 




CONTROL DATA 



TO 1002 IN FIG. 11 



BNSOOCID: *P_j07e2«2Aa_L> 



34 



EP 0 762 422 A2 



FIG. 23 



2301 












-2302 









■2304 



2303 



<ROOT>- 



<PBC> 



<VIDEO> 



<MENU> 



<WWW> 



<PCAP> 



FIG. 24 



PBC. DAT 
VIOE0001.DAT 
VIDE0002. DAT 
VIDE0003. DAT 

MENU06l.DAT 
MENU002. DAT 
MENU003. DAT 



-2401 



2402 



<HTML> 



INDEX. HTM 
PAGE001.HTM 
PAGE002. HTM 



<GIF> 



MENU001.GIF 
MENU002.GIF 



STARTUP. EXE 
VCDVIEW. EXE 
WWWVIEW. EXE 



K2403 



AUTORUN. INF 



BNSOOOD: <EP_07e2422A2JL^ 



35 



EP 0 762 422 A2 



1 



DISPLAY WINDOW 



Go Go Ethnic! 

1. Ethnic Curry 

2. Ethnic Soup 

3. Sp i ces 



2501 



FIG. 25 a 



USER SELECTS 1 
SELECT RETURN 
USER SELECTS 3 





SELECT RETURN 



Spices 

Cumin 
How to use: 
Next spice^ 



FIG. 25 b 



NODE 
NUMBER 


IMAGE DATA 


KEY 1 1 KEY 2 


KEY 3 


RETURN 


PREV 


NEXT 


1 


MENU0001.DAT 


NODE 2 


NODE 3 


NODE 4 








2 


VIDE0001.DAT 








NODE 1 






3 


VIDE0002.DAT 








NODE 1 






4 


MENU002. DAT 








NODE 1 




NODE 5 



















BN80OCI0: <EP_07e2422Aaj_> 



36 



EP 0 762 422 A2 



FIG. 26 



2605 



2601 

__L 



rev; fid home 

1^ 



Ou it 



Go Go Ethnic ! 

1 . Ethnic Curry 

2. Ethnic Soup 

3. Spices 



112 4 3 




User selects 1 



Select 
2606 



n 



2607 
Select 



User 
se I ects 

2603 
L 



REV FVD HOME 



Ou I t 



El 



Sp i ces 

How to use : 



Next spice 



Order ¥200 



User selects 
"order" 



Select 



Confirm 



or 



Cancel 



2608 



REV FID HOME 



Ethnic Curry 




2602 



Quit 



How to make Ethnic Curry 



n 



REV FWD HOME 



2604 
_1_ 



Qu it 



Order of spice 
Cumin 
¥200 



member 
ID 



2609 



Confirm 



Cance I 



2610 



2611 



BNSDOCID: <EP__P7e2422A2J_> 



37 



EP 0 762 422 A2 



FIG. 27a 



INDEX. HTM 



<HTML> 

<!-- VIDEOCD+HTML DOCUMENT --> 
<TITLE>Go Go Ethnic! </T I TLE> 
<BOOY> 

< IMG SRC ="../GIF/MENU001.GIF'><BR> 

<A HREF ^PAGEOOLHTM") . 

<IMG SRC ="../GIF/KEY1.GIF'></A> 

<A HREF =*PAGE002.HTM"> 

<IMG SRC ="../GIF/KEY2.GIF''></A> 

<A HREF ="PAGE003.HTM''> 

<IMG SRC ="../GIF/KEY3.GIF"></A> 

</BODY> 

</HTML> 



FIG. 27b 

PAGE001.HTM 



<HTML> 

<!-- VIDEOCD+HTML DOCUMENT --> 
<TITLE>Ethnic Curry</TITLE> 
<BODY> 

<A HREF ="../../VIDE0/VIDE0001.DAT''> 
<IMG SRC =" ../GIF/VIDE0001.GIF"><BR> 
How to make Ethnic Curry</A><BR> 
<A HREF = 'INDEX. HTM" > 

<IMG SRC =" ../GIF/RETURN.GIF"></A><BR> 

</B0DY> 

</HTML> 



BNSDOCID: <EP_07e24a2A?J_>^ 



38 



EP 0 762 422 A2 



FIG. 28 a 

PAGE003. HTM 



<HTML> 

<!-- VIDEOCD+HTML DOCUMENT -> 

<TITLE>Spices<AlTLE> 

<BODE> 

<IMG SRC ./GIF/MENU002.GIF''><BR> 

<A HREF = 'INDEX. HTM" > 

<IMG SRC ="../GIF/RETURN.GIF''></A> 

<A HREF = "PAGE004.HTM'' > 2801 

<IMG SRC =\. /GIF/NEXT. GIF" ></A><BR> \ 

<A HREF s^httprZ/wwuf. ethnic. XXX. xxx/orderl. htm"> 

Order ¥200 </A><BR> . 

</BODY> 

</HTML> 



FIG. 28b 

0RDER1.HTM 



<HTML> 

<!-- VIDEOCD+HTML DOCUMENT --> 

<TITLE>Spices Order 1</TITLE> 

<BODY> 2802 

<U>Order of spice</U><BR> ' 

< IMG SRC =" ../GIF/SPICEl.GIF">Cuniin<BR> 2803 

¥200 <BR> ? 

<FORM METHOD ='POSr ACTION = "eg i -bin/post -query" > 

Member ID < INPUT TYPE =''text" NAME ="'id"><BR> 

< INPUT TYPE = "submit' VALUE ="Confirm"> S 

<INPUT TYPE =Veset" VALUE ="Cancel"> l 2804 

</FORM> 

2805 



BNSOOCID: <EP__jl)7B2422A2J^ 



39 




THIS FASi BLANK (usPTO) 



